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The  channel  model  is  of  the  slotted  packet-switched  satellite 
broadcast  type  which  is  described  in  12,  sect.  5.11].  There  is 
an  infinite  population  of  packet  transmitting,  bursty  users. 

The  cumulative  input  traffic  is  modeled  as  a  homogeneous  Poisson 
point  process  with  intensity  X  messages  per  slot.  If  each  of  two 
or  more  users  transmits  a  packet  during  a  slot,  the  packets 
"collide"  and  are  not  successfully  broadcasted.  Such  packets  join 
the  backlog  of  packets  which  must  be  rebroadcasted  at  a  later 
time.  During  each  slot,  each  user  possessing  a  backlogged 
packet  must  decide  whether  or  not  to  transmit  the  packet  in 
that  slot.  It  is  assumed  that  at  the  end  of  the  slot  (t,  t+l3 
(t  is  integer  valued)  each  user  learns  the  value  of  a  common 
feedback  random  variable,  Z^. 

The  feedback  informs  the  users  whether  slot  (t,  t+1]  was 
empty  (Z^  =  0) ,  or  contained  one  packet  (Z^  =  1) ,  or  contained 
^  2  packets  (Z^  =  e) .  Let  denote  the  channel  backlog  at  time 
t.  Each  user  with  a  backlogged  packet  independently  transmits 
the  packet  with  the  same  probability  in  the  slot  (t,  t+1]. 

The  sequence  satisfy  0  ^  f^  £  1  and  f^  must  be  a 

function  of  the  channel  output  history  <  t)  for  each  t. 

The  retransmission  control  policy  examined  in  [1]  is  of  the  form 


(1) 


^t+1  “  niin(a(Z^)  e) 

for  some  positive  constants  y ,  6,  a(0) ,  a(l),  a(e) .  Next,  it  is 
specified  how  the  new  packets  access  the  channel.  Let  be  the 
number  of  packets  which  first  arrive  during  the  slot  ending  at 
time  t.  The  random  variables  {Y. }  are  independent  with  Poisson 

^  tEZ 

distribution  (X) .  Two  first- time  transmission  policies  are 
considered,  namely  Immediate-First-Transmission  (IFT)  and 
Delayed-First-Transmission  (DFT) .  Under  the  IFT  policy,  each  of 
the  Y^  packets  which  arrive  during  slot  (t-1,  t]  are  first 
transmitted  in  slot  (t,  t+1]  with  probability  one.  Under  the 
DFT  policy,  new  packets  join  the  backlog  before  their  first 
transmission  is  attempted,  i.e.  each  of  the  Y^  packets  is 
independently  transmitted  in  slot  (t,  t+1]  with  probability  f^. 

Let  be  the  total  traffic  intensity  at  time  t  and  let 
be  the  expected  throughput  during  slot  (t,  t+1],  given  N^ 
and  f^.  Thus,  =  P[Z^  =  1|N^,  f^] •  Using  a  Poisson  approximation 
to  the  binomial  distribution,  a  "local"  Poisson  approximation  is 
introduced  in  [1] .  The  "local"  Poisson  approximation  consists 
in  approximating  the  conditional  distribution  of  the  number  of 
retransmitted  packets  in  slot  (t,  t+1]  by  a  Poisson  distribution 
with  mean  =  N^f^.  Thus, 


where  =  X  +  for  the  IFT  policy  and  G^  =  for  the  DFT 
policy. 

It  is  not  difficult  to  see  that  the  pair  process  (N^,  f^) 
forms  a  Markov  chain  with  state  space  Z^  x  [0,  1].  The  importance 


3 


of  the  "local"  Poisson  approximation  hinges  on  the  fact  that 
the  transition  probabilities  of  the  chain  (N^,  f^)  depend  on 
and  f^  only  through  the  product 

Another  important  point  is  that  under  the  retransmission 
policy  considered  in  [1]  the  dynamics  of  the  total  channel  traffic 
suffer  disturbances  only  of  order  0(l/n)  due  to  the  fluctuation 
of  the  amount  of  backlogged  traffic,  when  the  backlogged  size 
is  near  n.  Hence  the  total  traffic  level  is  nearly  decoupled 
from  the  size  of  the  channel  backlog,  as  long  as  n  is  large 
enough.  This  fact  justifies  the  use  of  the  following  "local 
model"  for  the  retransmitted  traffic . 

Fix  an  integer  n  >  0.  The  Markov  chain  (f”)  obtained 
by  localizing  the  Markov  chain  (f^,  N^)  to  (N^)  =  n  has  the 
transition  probabilities: 


e" 

t+1 


=  min 


-G, 


a(0)^  with  probability  e 


-G, 


6,  f^  x^ad)’  with  probability  G^e 

-G. 

a(e)^  with  probability  1-(1+G^)e 


(2) 


where  G^  =  X  +  nf"  for  the  IFT  policy  and  G^  =  nf^  for  the  DFT 
policy. 

If  we  define  <t»”  =  ln(nf”)  for  n  >  0,  then  =  exp(<j)”) 
represents  the  total  retransmitted  traffic  intensity  for  the 
"local  model".  Further,  ((>^)  is  itself  a  Markov  chain  with 


transition  probabilities 
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/  ^(0)  with  probability  e  ^  \ 

=  min(/ln(nB),  4”  +  C{1)  with  probability  G^e  ^  I 

C(e)  with  probability  1-(1+G^)e  ^ 

where  C(i)  =  ln[a(i)]  for  i  =  0,  1  or  e.  The  important  point 
here  is  that  the  transition  probabilities  of  (}>”  do  not  depend  on 
n,  except  through  the  term  In(nB).  The  minimtim  in  (3)  simply 
reflects  the  fact  that  =  ln(nf”)  £  In(nB)  for  all  t.  As  n 
increases,  the  constraint  (ji”  £  ln{nB)  becomes  less  crucial.  Hence, 
we  study  only  the  process  with  transition  probabilities 

/C(0)  with  probability  e 

■^t 

+  Y  Jc{l)  with  probability  G^e  (4) 


C(e)  with  probability  1-(1+G^)e 


where  G^  = 


2 .  Drift  and  Variance  Analysis  of  the  Local  Model 

Equation  (4)  defines  the  following  stochastic  recursion 
for  the  log-intensity  of  the  "local  model" 

Given  $^  =  $  the  sequence  ^tcz"*"  ®  random  variable 

sequence  with  stationary  distribution 

=  C(0)  1$^  =  ,^}  =  e"^ 

P{C^($^)  =  C{1)U^  =  ()>}=  Ge"^ 

P{C^($^)  =  C(e)U^  =<«>}  =  1-(1+G)e‘^ 

where  G  =  Gj($)  =  A  +  exp($)  for  the  IFT  policy  and  G  =  Gjj($)  =  exp(f) 
for  the  DFT  policy. 

Recursions  of  the  same  form  to  the  one  given  above  have 
been  studied  in  the  context  of  recursive  stochastic  algorithms 
in  the  estimation  and  control  literature.  To  analyze  the  recursion 
described  by  [5]  ,  we  shall  employ  some  known  theoretical  results 
for  evaluating;  (1)  the  motion  of  the  "mean  value"  of  which 
will  be  associated  with  the  solution  of  an  ordinary  differential 
equation,  (2)  the  evolution  of  the  difference  which 

will  be  described  by  a  linear  diffusion  model. 


iiimmitiMiaiilSm 


2.1.  The  associated  ordinary  differential  equation 


It  is  known  that  seen  as  a  perturbed 

discrete- time  approximation  of  the  solution  of  an  associated  ordinary 
differential  equation  with  discretization  step  y-  The  corresponding 
result  can  be  given  in  the  form  of  a  theorem  (see  [3]  -  [6],  for 
details  and  explicit  required  conditions) . 

Theorem  1 ;  For  every  e  >  0  and  T  <  ® 

lim  P{  max  1$  -  $  (yt)  ]  >  e)  =  0 

Y-+0  l£Yt<^T 

where  $(t^)  denotes  the  solution  of  the  ordinary  differential 
equation  associated  to  (5)  : 


w($)  /  ^ (0) 


(6) 


where  w($)  =  m($)/Y 

m($)  =  =  <?}  =  E{yC^{$^) 

and 

^^t  =  ^t+1  ■  ^t 

In  the  above  theorem  t^  indicates  the  continuous  time  of  the 

c 

ordinary  differential  equation  (6)  and  t  the  discrete  time  of  the 
recursion.  Under  the  correspondence  t^-yt,  $(yt)  represents  a 
discretization  of  the  solution  $(t  )  of  (6)  with  step  y. 
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2.2.  The  diffusion  approximation 

We  now  introduce  a  diffusion  approximation  model  describing 
the  evolution  of  the  difference  (for  t^  =  yt)  as 


.  For  T<“,  let  (X^  ) 

c  0<t 

process  such  that 


be  the  continuous-time  stochastic 


't  -^tc 


*  for  t^  =  Yt 


Under  realistic  assumptions  (see  (3]  -  [6]),  we  have  the  following 
theorem. 

Theorem  2 ;  The  process  (X^  )  converges  weakly  as  Y"*’®  to  the 

^0_<t_<T 

Gaussian  process  (X  )  which  is  the  solution  of  the  following 

c  Oj<t_<T 

linear  stochastic  differential  equation: 

dX^  =  A($(t^))X^.  dt^  +  (t^)  )dW^  ,  ^0  "  ° 

c  ^c  c 


where  (W^  )  is  the  standard  Wiener  process,  and 
'"c 

A($)  =  ^  w($) 


Q($)  =  I  Cov(C^(|) ,  Cq($) ) 
tezt 


the  series  being  assumed  convergent. 


Next  we  are  interested  in  studying  the  evolution  of  the 
difference  -  ^(t^)  when  lies  near  some  stable  equilibrium 
of  the  ordinary  differential  equation  (6),  denoted  by 


3.  Speed  of  Convergence  Versus  Steady  State 


Accuracy  for  the  Local  Model 


For  the  recursion  described  by  (5)  we  have: 


m(x)  =  yC  •  b^ (x) 


w(x)  =  m(x)/Y  =  c  •  b  (x) 


where 


C  =  (C  (0)  ,  c  (1)  /  C(e) ) 

b(x)  =  [exp(-G(x)),  G(x)  •exp(-G{x)  )  ,  1- ( 1+G  (x)  )  -exp  (-G  (x)  )  ] 


If  we  define  then 

V($)  =  Y^(C{0)^,  c(l)^,  C(e)^)  .  b’^(x)  -  m^(x) 

By  definition,  Q(^)  =  I  ^  cov(C^($),  Cq($)).  But 

tez  ^ 

is,  given  |,  a  sequence  of  i.i.d.  random  variables,  which  are  also 

assumed  independent  of  Cq(|).  Thus 

Q(x)  =  cov(C^(x),  C^(x))  =  G^(x)/y^  = 

=  (C^(0),  C(l)^,  C(e)^)  •  b(x)  -  w^(x) 


By  the  "local"  Poisson  approximation,  the  expected  throughput 
in  slot  (t,  t+1],  given  is  S^  =  G^e  where  =  G($^), 
which  is  maximized  when  G^.  =  1.  If  the  goal  of  the  transmission 
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policy  is  to  maximize  the  throughput  then  we  should  choose 

C(0),  C(l)  and  c(e)  such  that  the  equilibrium  point  of  the 

ordinary  differential  equation  (6)  is  unique,  stable  and  optimal. 

A  stable  equilibrium  point  is  optimal  if  it  maximizes  the 

throughput  S.  =  S($  ),  i.e.  if  G($^)  =  1,  since  then 
■^t  -1 

S($*)  =  max(G.e  )  =  e  .  Hence,  for  |  lying  near  it  is 
^t 

reasonable  to  replace  the  model  (7)  by  the  following  simplified 
time- invariant  linear  stochastic  differential  equation: 

dX.  =  AX.  d^  +  dW^  (8) 

^c  ^c  ^c 

where 

A  =  A($*);  A(x)  =  ^  w(x) 

Q  =  Q(^*) 

and  w (x)  is  as  defined  in  equation  (6) . 

It  is  noteworthy  that  equation  (8)  is  simply  the  Langevin  random 

differential  equation  [7,  Section  7.2].  The  density  function  of 

X^  is  the  familiar  one  associated  with  the  Ornstein-Uhlenbeck 
c 

process.  The  stationary  solution  of  (8)  is  Gaussian  with  mean 
zero  and  variance  -Q/2A,  i.e, 

$  “  ^ 

(X  )  =  — - -  'x-  N(0,  -Q/2A)  (9) 

^C  S  /y 

If  we  use  the  "unnormalized"  difference  ~  then  (9)  is 

equivalent  to : 

'V  N(0,  -  yQ/2A)  (10) 

In  other  words,  for  t->-“  and  for  sufficiently  small  y  (theoretically, 
Y-*-0)  the  difference  -  $*  is  a  Gaussian  random  variable  with 
mean  zero  and  stationary  variance  V  =  -yQ/2A. 

5 
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Now  using  the  above  results  we  are  able  to  derive  measures 
of  the  speed  of  convergence  and  steady  state  accuracy  for  the 
"local  model"  of  the  recursive  retransmission  policies  under 
consideration . 

The  following  conditions  ensure  that  the  point  if*  is  an  optimal  stable 
equilibrium  point  of  the  ordinary  differential  equation  (6) . 


w($*)  =  0,  A(|*)  =  ^  w(x} 


x=$. 


and  G($*)  =  1 


(11) 


Conditions  (11)  are  equivalent  to  the  following  conditions  on 
C(0) ,  C(l) ,  C(e)  that  were  derived  in  II] 

c(e)<^0_<c{0)  and 

C(e)  =  -(c(0)  +  c(l))----^  (^2) 

l-Ze"-^ 


As  we  can  see  from  (4)  the  step  sizes  of  the  Markov  chain  (f^) 
are  proportional  to  y .  If  y  is  fairly  large,  $  will  quickly 
approach  the  vicinity  of  its  optimal  value.  A  glance  at  the 
associated  differential  equation  leads  us  to  the  same  conclusion 
since  y  represents  the  discretization  step  size. 

A  first  order  approximation  of  (6)  around  <?  =  f*  gives: 


=  A($*)  (f  -  f*)  +  o((f  -  f*)^)  (13) 


From  (13)  we  conclude  that  the  speed  of  convergence  of  f  to  the 
vicinity  of  f*  is  related  to 


A  =  A(f*) 


dw(x) 

dx 


x=f* 


Hence,  it  is  desirable  to  have  A  as  negative  as  possible.  Notice 
that  A  represents  the  slope  of  the  normalized  expected  drift 
w{*)  o'  (4)  at  the  equilibrium  point.  On  the  other  hand,  the 
stationary  variance  of  the  linear  diffusion  model  =  -yQ/2A 
is  a  linear  function  of  y  (for  y  sufficiently  small) .  Hence  a 
larger  y  will  result  in  larger  fluctuations  of  $  around  its 
optimal  value  This  in  turn  will  result  in  a  larger 

stationary  deviation  of  the  throughput  S($^)  from  the  optimal 
=  e"^. 

If  Y  is  very  small,  then  $  approaches  more  slowly,  but  on 
the  average  remains  closer  to  after  the  longer  transient  period. 
Therefore,  we  have  here  another  manifestation  of  the  usual  trade-off 
between  speed  of  convergence  and  steady  state  accuracy. 

From  the  equilibrium  analysis  of  the  diffusion  model  corre'sponding 
to  the  local  model  (4)  we- have; 

lim  S.  =  e  ^  =  S ( A*) 

y^o  ^ 

where  S  =  E{S(|  )}  denotes  the  expectation  of  s'(  $  )  relative  to 
s 

the  stationary  distribution  of  given  by  (10) .  Let  us  expand 
S($^)  around  we  have 

Ut  - 

S($^)  =  S(^*)  +  ($^  -  $*)S’($*)  +  — ^ -  S"((f*)  +0((|^  - 

TaJcing  expectations  with  respect  to  the  stationary  distribution 
yields 

=  e  ^  -  yR  +  o(y) 


where 


R  =  ^  (1/2  S"($*)) 

Hence,  R  reflects  the  effect  of  the  fluctuations  of 
aroxind  its  optimal  value  on  the  average  throughput  induced  by 
different  transmission  policies. 

For  a  fixed  value  of  y  the  values  of  |a|  and  represent 


measures  of  the  speed  of  convergence  and  the  steady  state  accuracy 
respectively  for  different  transmission  policies. 


In  [1]  the  DFT  policy  is  proposed  as  a  robust  alternative 
first- transmission  policy  to  the  IFT.  The  DFT  policy  can  ensure 
stability  (in  the  sense  of  [8,  Theorem  5.1])  for  any  i.i.d. 
arrival  process  (Y^)  with  X  =  E(Y^)  <  e~^  and  £[6*^^^]  <  +® 
where  e>0. 

We  are  interested  in  comparing  the  two  policies  in  terms  of 
speed  and  accuracy  using  the  measures  |a|  and  r“^. 


Hence 
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Case  A;  Iiranediate-First-Transmission  (IFT) 

In  this  -ase  the  "local"  traffic  intensity  is 

=  A  +  exp($^)  and  =  In(l-A)  (16) 

Substitution  of  (16)  into  (14)  and  (15)  yields 

=  e”^(C(e)  -  C(0))(1  -  A)  (17. a) 

^  4(C(0)  -  C{e))  (17. b) 


Case  B;  Delayed-First-Transmission  (DFT) 

In  this  case  the  "local"  traffic  intensity  is 

=  exp($^)  and  $*  =  0  (18) 

Substitution  of  (18)  into  (14)  and  (15)  yields 

=  e“^(C(e)  -  C(0))  (19. a) 

4(C(0)  -  C(e))  (19. b) 

Comparing  (17)  to  (19)  we  conclude  that,  under  Poisson  statistics, 
the  two  policies  are  equivalent  in  terms  of  speed  and  steady  state 
accuracy  for  the  local  model,  if 


Yd  = 


A) 


A  note  on  the  selection  of  £ 

The  only  constraint  imposed  so  far  on  the  three  parameters 
C(0),  C(l),  C(e)  is  that  they  have  to  satisfy  the  conditions  given 
by  (12). 
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We  propose  the  following  criterion.  Choose  C(0),  C(l),  C(e) 
so  that  the  steady  state  accuracy  is  maximized  under  fixed  speed. 
In  other  words,  the  objective  is  to  minimize  R  for  fixed  A.  We 
fix  A  by  setting  C(0)  -  C(e)  =  1.  There  is  no  loss  of  generality 
in  doing  so  since  according  to  conditions  given  by  (12) ,  the 
parameters  C(0),  C(l),  C(e)  are  determined  up  to  a  multiplicative 
constant  which  can  be  incorporated  in  the  value  of  the  gain  y 
After  this,  the  problem  is  the  following: 


minimize  R 

subject  to  C  ^  0,  C(e)  £  0  £  C(0)  ,  C(0)  -  C(e) 


and 

C(e)  =  -(C(0)  +  C(l)) 


-1 

e 


1 


The  solution  to  the  above  problem  is  the  following: 


I 


C(0)  =  *  .418,  C(l)  =  0,  C(e)  = 

l-e'-^ 


=  -.582  (C.l) 


for  both  IFT  and  DFT  policies.  It  is  noteworthy  that  the  above 
choice  of  C  is  identical  to  the  one  given  in  [1] ,  derived  after 
the  "economical"  but  otherwise  arbitrary  choice  of  C(l)  =  0. 

Substitution  of  the  above  choice  of  C  into  (14)  and  (15)  gives: 


where 

1  for  the  IFT  policy 

G'(n)  = 

1-X  for  the  DFT  policy 


i 

5 .  Retransmission  Control  Policies  under 
Binary  Feedback 

The  retransmission  control  policies  examined  so  far  assume 
that  at  the  end  of  the  slot  (t,  t+1],  each  user  learns  the  value 
of  a  common  ternary  feedback  random  variable  Z(t).  We  have 
Z(t)  =  0,  or  1,  or  e  depending  on  whether  slot  (t,  t+1 ]  was  empty, 
or  contained  one  packet,  or  contained  2  packets  respectively. 

In  a  random  multiple-access  channel  like  the  one  considered 
here,  there  are  situations  where  ternary  feedback  might  not  be 
available.  A  very  interesting  feature  of  the  retransmission 
policies  of  Hajek  and  Van  Loon  is  that  they  can  still  achieve 
a  stable  throughput  of  e  ^  =  .3678  under  certain  types  of  "binary" 
feedback . 

Binary  feedback  uses  less  feedback  information  compared  to 
ternary  feedback  and  can  be  available  in  three  different  types 
(classification  suggested  by  Mehravari  and  Berger  [9]): 

if  ^  2  packets  in  slot  t  (conflict) 
if  ^  1  packet  in  slot  t  (no  conflict) 

if  1  packet  in  slot  t  (something) 
if  no  packet  in  slot  t  (nothing) 

if  one  packet  in  slot  t  (success) 
if  either  no  or  >  2  packets  in  slot  t  (failure) 


r 

c 

NC 


S 

N 


Zgp ( t) 
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The  conflict/no  conflict  (CNC)  feedback  informs  the  users  only 
about  whether  or  not  there  was  a  conflict  in  the  previous  slot. 

The  retransmission  policy  given  by  (1)  can  be  implemented  under 
CNC  feedback  by  merely  choosing  a  different  vector  C,  to  accommodate 
an  additional  condition  introduced  by  the  reduction  in  the  feedback 
information.  The  additional  condition  is:  C(0)  =  C(l).  This 
results  in  the  following  choice  of  C  [I] . 

=  (0.209,  0.209,  -0.582) 

CNC  binary  feedback  has  recently  been  studied  by  Mehravari  and 
Berger  [9].  Their  scheme  uses  a  collision  resolution  algorithm 
to  achieve  a  stable  throughput  of  .4422.  Also  in  [10]  a  very 
easy  to  implement  limited  sensing-type  algorithm  with  CNC  binary 
feedback  is  proposed  which  achieves  a  stable  throughput  of  at 
least  .363. 

Something/nothing  (SN)  feedback  informs  the  users  about 
whether  or  not  the  previous  slot  was  empty.  This  type  of  feedback 
is  characteristic  of  public-key  secure  computer  communications. 

The  retransmission  policy  given  by  (1)  can  be  implemented  under 
SN  feedback  by  choosing  Cg^^  =  (.462,  -0.269,  -0.269)  [1].  In 

[9]  a  stable  throughput  of  .279  is  achieved  by  using  a  collision 
resolution  algorithm. 

5.1.  Retransmission  control  policy  under  success/failure  (SF) 
feedback 

The  success/failure  (SF)  feedback  informs  the  users  about 
whether  or  not  the  previous  slot  contained  exactly  one  message. 

This  situation  arises  if  the  receiver  cannot  distinguish  between 
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channel  noise  and  collision  noise.  As  it  is  pointed  out  in  [9] , 
spread-spectrum  random  access  systems  result  in  SP-like  feedback 
in  the  event  that  the  users  attempt  to  disguise  the  fact  that  they 
are  communicating  by  keeping  the  transmitted  power  very  low.  In 
this  case,  the  noiselike  waveform  that  results  from  the  collision 
of  two  ore  more  transmitted  signals  is  difficult  to  distinguish 
reliably  from  noise  alone. 

The  policies  introduced  by  Hajek  and  Van  Loon  [1]  do  not 
cover  success/failure  feedback.  The  reason  for  this  is  simple. 

SF  feedback  introduces  the  following  condition  on  C(0),  C(l), 

C{e)  in  addition  to  the  conditions  given  by  (12): 

C(0)  =  C(e)  -  C(0e)  =  common  constant  (20) 


It  is  easy  to  see  that  there  is  no  choice  of  C  that  satisfies 
both  (12)  and  (20)  . 

Let  us  now  use  the  associated  ordinary  differential  equation 
model  introduced  in  section  2.1  to  get  some  insight.  The 
stability  of  the  differential  equation  given  by  (6)  depends  on 
the  sign  of  A($*)  of  the  linearized  equation  given  by  (13). 
Consequently,  the  existence  of  a  stable  equilibrium  point 
depends  on  whether  A((ji*)  <  0,  or  equivalently  on  whether 

(C(l)  -  C(0e))(l  -  G*)G'*exp(-G^)  <  0  (21) 


where 


G*  =  G((|r*) 

g;  »  ^  GOO 


:  < Am:  ' 
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(In  deriving  (21)  we  have  used  condition  (20).) 

Now  the  difficulty  in  the  SF  feedback  case  is  apparent.  If 
we  insist  in  establishing  a  stable  equilibrium  point  which 
is  optimal  in  a  throughput  maximizing  sense,  i.e.  S($*)  =  e~^ 
or  equivalently  G*  =  1,  then  we  cannot  guarantee  stability  since 
from  (21)  we  have  A($*)  =  0. 

The  only  way  to  get  around  this  difficulty  is  to  relax  the 

optimality  requirement  G*  =  1.  If  we  fix  G^  ^  1,  then  any 

such  that  G($  )  =  G  can  be  made  the  only  stable  equilibrium  point 
s  s 

of  the  associated  differential  equation  by  an  appropriate  choice 
of  the  parameters  C(l)  and  C(oe).  The  required  conditions  are: 

w($g)  =  0  and  ® 

or  equivalently 

C(0e)(l  -  G^e  ^)  +  C(l)Gge  ®  =  0 

and 

-G 

(C(l)  -  C(oe))(l  -  Gg)G^  e  ®  <  0 

For  fixed  G^  >  1  conditions  (22)  ,  (23)  are  equivalent  to  the 
following: 

C(l)  >0,  C(oe)  <0,  and 


If  we  further  impose  the  normalizing  condition 
|C(1)|  +  2|C(oe)|  =  1,  then  we  have: 

G_  ^  G 

C(G„)  =  (C(0),  C(l),  C(e))  =  (e  ®  +  G^)"-^  •  (-G^,  e  ®  -  G„ ,  -G„) 
s  s  s  s  s 


(22) 


(23) 


(25) 
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For  this  choice  of  C  we  have: 

■®s 

lim  S.  =  G_e  for  any  faxed  G  >  1  (25) 

Y-+0  ^  s  ® 

Hence,  the  retransmission  control  policy  given  by  (1)  can  cover 

the  case  of  success/failure  (SF)  binary  feedback  with  the  choice 

of  C  given  by  (25)  and  is  stable  for  X  <  GgC  for  any  fixed 

G_  >  1,  if  Y  is  sufficiently  small.  For  example,  if  G  =  1.2 
s  s 

then  for  C(1.2)  =  (-.265,  .469,  -.265)  and  sufficiently  small  y  the 
scheme  is  stable  for  X  <  .3614. 

Note  that  we  can  satisfy  conditions  (22)  and  (23)  by  fixing 
0  <  Gg  <  1.  The  above  results  are  valid  for  this  case  too  except 
that  now  we  have  to  choose  C(l)  <  0  and  C(oe)  >  0.  For  0  <  G^  <  1 
the  choice  of  C  is  the  following: 

G  ,  G 

C(Gg)  =  (e  ®  +  Gg)"-^(Gg,  ■  B  Gg)  (27) 


5 . 2  Measures  of  the  speed  of  convergence  and  steady  state 
accuracy  for  the  S/F  retransmission  control  policy 

After  simple  calculations,  we  have: 

-G 

A(Gg)  =  (C(l)  -  C(oe))(l  -  Gg)G^  e  ®  (28) 


[(G"  -  (G')^) (1  -  G_)  -  (G')^] 
Alhi)  -  cTo-eTTTi  -  G Jg:  ■ 

5  S 


(29) 


where 
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‘^Tern.  ^  ^CNC  ^ 

The  order  of  the  above  inequalities  is  in  agreement  with  the 
classification  given  in  (9],  where  the  SF  binary  feedback  is 
classified  as  the  least  informative. 


6.  Effects  of  Channel  Errors 


Thus  far  it  has  been  assumed  that  all  users  receive  perfect 
information  regarding  the  channel  output.  In  other  words,  after 
each  transmission  slot,  all  users  correctly  detect  whether  the  slot 
was  empty  ("0"),  or  contained  one  packet  ("1"),  or  contained  a 
collision  ("e") . 

We  now  consider  the  more  realistic  situation  where  channel 
noise  can  affect  the  detections.  In  this  case  the  updation  of 
the  retransmission  probabilities  will  be  based  on  inform.ation  that 
inaccurately  represents  the  outcome  of  the  previous  transmission. 

In  modeling  detection  errors  we  assume  only  system-wide  errors, 
i.e.  when  an  error  is  made,  all  users  make  the  same  error.  This 
is  realistic  if  the  users  are  relatively  close  together,  or  if  the 
feedback  information  is  received  in  the  form  of  an  acknowledgement 
from  a  central  facility.  Although  in  some  applications  different 
users  may  receive  different  information  about  the  channel  status, 
the  system-wide  error  analysis  could  still  be  used  as  a  measure  of 
the  degradation  of  the  system's  performance. 

The  effect  of  channel  feedback  errors  will  be  analyzed  using 
the  local  model.  We  consider  the  following  six  possible  types  of 
detection  errors: 


I 
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=  Pj,  (1  detected  1 0  sent) 

P  =  P  (>2  detected  1 0  sent) 

Pj^Q  ~  detected  1 1  sent) 

Pj^g  =  P^  (^2  detected jl  sent) 

P^Q  =  (0  detected]^  2  sent) 

P  ,  =  Pv  (1  detected  I >  2  sent) 

The  notation  P^^  is  used  to  indicate  both  the  type  of  error  and  the 
corresponding  probability. 

At  time  k  let  the  total  traffic  intensity  be  G($j^)  =  G.  Also 
let  b^  =  P^  (o  sent)  »  ==  Pj-  ^  ^  sent)  and  b^  =  P^.  (^2  sent)  . 

If  Pq/  Pj^,  Pg  denote  the  probability  of  detecting  an  empty, 
successful,  collided  transmission  respectively,  given  G,  then 


P  =  bP 


where  p.  =  (Pg/  P^/  Pg)  »  b  = 

1- (1+G) exp (-G) )  and 

(bQ  0  bj^ ,  b2 ) 

-  (exp(-G) 

^■^0l"^oe 

^01 

^oe 

P  = 

^10 

^■^10”^le 

^le 

^eo 

^el 

1-P  -P  , 
eo  el 

The  local  model  recursion  is  now  the  following 

yC(0)  with  prob.  Pq ^G^) 

+  yCil)  with  prob. 

YC(e)  v;ith  prob.  P^fG^) 

where  G^  =  G($^) 


- 
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Given  a  specific  choice  for  C,  an  equilibrium  point  of 
(30)  satisfies  the  following  equation. 


m  m 

C  b  =  0 


The  equilibrium  point  will  be  stable  if  and  only  if 

A  =  (C  b"^)  I  <0 

34'  -  -  ^ 


Notice  that  in  the  error-free  case  P  is  the  unit  matrix  and  (31), 

(32)  reduce  to  the  conditions  given  by  (12) . 

In  what  follows,  we  study  (31),  (32)  under  the  assumption  that 

^01  ^10  "  ^el  ""  ^eO 

It  can  be  argued  that  under  usual  operation  of  the  system, 

P^^  and  Pj^g  are  the  more  likely  errors  to  occur.  It  is  unlikely 
that  noise  would  be  interpreted  as  a  "single  packet"  (Pq],)  because, 
in  practice,  each  packet  transmitted  would  be  encoded  with  a 
sufficiently  powerful  error  detecting  code.  For  the  same  reason  it 
is  unlikely  that  a  "collision"  would  be  interpreted  as  a  "single 
packet"  ,  unless  the  system  is  operating  as  a  public-key 

secure  computer  communication  system  where  any  user  other  than  the 
intended  recipient  cannot  distinguish  between  a  "single  packet"  and 
a  "collision."  A  signal  to  noise  ratio  argument  could  be  used  to 
justify  that  is  also  very  unlikely  that  one  or  more  messages  would 
be  undetected  (Pj^q  or  P^q)  •  This  is  not  true  only  in  special 
purpose  random  access  systems  like  the  one  employing  spread  spectrum 
modulation  techniques  where  the  users  cannot  distinguish  between 
channel  noise  and  collision  noise  because  they  attempt  to  disguise 
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the  fact  that  they  are  communicating  by  keeping  the  transmitted 
power  low. 

On  the  other  hand,  an  empty  slot  could,  because  of  noise  on 
the  transmission  channel,  reach  the  users  as  a  "garble"  that  they 
are  forced  to  interpret  as  a  "collision"  (Poe) .  Also  a  "single 
packet"  slot  might  result  in  a  "collision"  interpretation  because 
of  detected  bit  errors  in  the  encoded  packet  on  the  noisy  channel. 
The  probability  of  this  type  of  error  could  be  significantly 
decreased  if  some  error-correction  were  employed  in  addition  to 
error  detection. 

In  a  realistic  random-access  situation  one  would  anticipate 
the  inequality 


P  <  P,  <<  1 
oe  le 


Under  the  previous  assumption  equation  (31)  yields 


where 


C(0)  a  exp(-G)  +  C(l)6  G  exp(-G)  +  C(e)(l  -  (a+BG) exp (-G) ) 

(33) 


ct  =  1  -  Ppg,  6  =  1  - 


and 


G  =  G($g)  = 


A  +  exp($^)  for  the  IFT  policy 


exp($  )  for  the  DFT  policy 


From  the  stability  condition  (32)  we  have 


A  =  (a(C(e)  -  C(0)  +  6(C(1)  -  C(e)  )  (1-G)  )G'  exp(-G)  <  0  (34) 


where 
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dG  (x) 


dx 


x=$ 


=  exp(^g) 


If  we  know  or  have  an  estimate  of  and  using  (33)  we  can  find 

a  vector  C  such  that  the  equilibrium  point  is  unique,  stable  and 

optimal  in  the  throughput  maximizing  sense,  i.e.  =  $*,  where 
G($*)  =  1.  This  is  true  if  and  only  if 


-1 


C(e)  =  -(a  C(0)  +  6C(1)) 


l-(a+B)e 


(35) 


and 


C  0,  C(e)  <  0  <  C(0) 


(36) 


For  the  measure  |a|  of  the  algorithm's  speed  of  convergence  to  the 
neightborhood  of  we  have 

A  =  -a(C(0)  -  C(e))e"^  G’(^*)  (37) 

For  the  measure  R  ^  of  the  stationary  accuracy  we  have 


)  = 


4a(C(0)  -  C(e)) 


G’  ($*) 


(38) 


Next,  as  it  was  done  in  the  error-free  case,  we  choose 
C(0),  C(l),  and  C(e)  to  be  the  solution  of  the  following  optimization 
problem: 

Maximize  q  =  ,  subject  to  conditions  (35)  and  (36) 


The  solution  to  this  problem  is 
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fixed  as  in  (40) .  The  speed  of  convergence  of  the  algorithm  is 
proportional  to  y|a|  and  can  be  set  to  any  desired  level  by  an 
appropriate  choice  of  the  scalar  y.  Hence  the  choice  of  C  given 
by  (39)  also  achieves  the  greatest  maximum  stable  throughput 

=  e  ^  -  yR»  for  any  fixed  value  of  y»  i.e.  for  any  desired  speed 
of  convergence. 

As  it  can  be  seen  from  (40)  the  speed  of  convergence  depends 
only  on  Pq^  which  is  intuitively  pleasing,  since  with  C(l)  =  0 
(inaction)  the  updating  process  of  the  algorithm  is  based  solely  on 
the  discrimination  between  the  rewarding  event  "empty"  (C(0)  >  0) 
and  the  penalizing  event  "collision"  (C(e)  <  0). 

The  steady  state  accuracy  depends  on  both  and  it 

can  be  seen  from  (41) .  In  Fig.  1  the  stationary  throughput 
is  plotted  as  a  function  of  the  probability  of  error  P^  =  P^^  =  P^^ 
for  the  optimal  choice  of  C  given  by  (39)  and  for  different  values 
of  y.  The  values  of  C(0),  C(e)  used  were  normalized  so  that  all  the 
curves  in  Fig.  1  correspond  to  jAj  =  e  Notice  that  for  y  small 
the  decrease  of  ^ is  very  moderate  even  for  unrealistic  values  of 
the  probability  of  error. 

Next  we  consider  the  case  where  the  error-free  optimal  choice 
of  C  given  by  (C.l)  is  used  in  the  presence  of  errors.  In  this  case 
it  can  be  proved  by  studying  (33)  and  (34)  that  an  equilibrium 


point  exists  for  any  0  ^  Pj^^  <  1  if  and  only  if  Pq^  <  C(0) 


.418. 


Furthermore,  it  can  be  proved  that  if  an  equilibrium  point  exists 


then  it  is  unique  and  stable.  The  unique  stable  equilibrium  point 


is  no  longer  optimal  and  the  distance  from  its  optimal  value  4* 


increases  as  the  probability  of  error  increases.  For  excunple,  if 


=  .05  then  is  such  that  G($_)  =  .94,  while  if  =  .2  then 
is  such  that  G($g)  =  .63.  This  results  in  degradation  of  the 
maximum  stable  throughput  that  becomes  severe  as  the  probability 
of  error  increases.  This  is  apparent  comparing  the  curves  of 
for  the  error-free  choice  of  C  to  the  corresponding  curves  for  the 
optimal  choice  in  Fig.  1. 
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Much  of  the  work  in  the  present  paper  was  developed  in 
interaction  and  discussions  with  Prof.  P.  Papantoni-Kazakos ,  of 
the  University  of  Connecticut.  Her  ideas,  comments  and  inputs 
were  fundamental  in  the  development  of  the  work. 
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